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ABSTRACT 

A research and development model — the Counselor 
Repertoire Development (CRD) Sys ton. — in counselor education is 
proposed which would provide systematic procedures tor providing 
trainees with a variety of empirically validated, appropriately 
seguenced learning experiences for the achievement of operationally 
defined performance objectives. The model reveals dynamic interaction 
among research, training, and evaluation components- T he ;„cope of the 
CRD System includes five discrete counseling styles each constituting 
a module of learning. Each style is subdivided into strategies which 
are implemented by oper- 1 i.ona 11 y defined classes of counselor \eroa3 
responses and related discri mina tions. The proposed model, based upon 
an empirical functional analysis of the counseling tasX, allows 
questions heretofore extremely resi. c tant to empirical investigation 
to become amenable to rigorously controlled research. (CK) 
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AM INTEGRATED MODEL FOR COUNSELING 
RESEARCH, EDUCATION AND EVALUATION 

Edward W. Pepyne 
University of Hartford 

The Problem 



The development of verifiable and effective modelsrand 
strategies for the education of new counselors and the pro- 
fessional f np rovemen t of practioners continues to pose a 
challenging problem to counselor educators and supervisors. 

T rad 1 1 i onal 1 y, counselor education programs have employed a 
three Phase approach: (a) cognitive experiences such as lectures, 
readings and discussions In which trainees obtain an under- 
standing of philosophies, theories, facilitating conditions, 
techniques, etc. thought to be needed for adeouate counseling, 

(b) group activities and conf ronto t f ons designed to Increase the 
trainee's sensitivity of his affective responses In i nterpersonol 
interaction and (c) practfcum experiences In which the trainee is 
thrust into interaction with real clients in the hope that genera- 
lization from knowing and feeling to doing will occur. As Delaney 
(1969) fias observed, "The traditional counseling practfcum is a 
'hit and miss' affair with the supervisor hoping the counselor 
candidate has 'hit* all the experiences with clients necessary 
to help him develop the behaviors for good counseling, and hoping 
t):e student has 'mssed 1 clients he could actually harm through 
Incompetence p, 3.83 . 11 Arnold (1962 ) cryptically summed up the 
state of the art by asserting thot counselor educators "simply do 
not know what they are doing or how to evaluate It p. 189 * ,r 



A Proposed Research and Deve l opment Model 

What appears to be needed in counselor education are systematic 
procedures for rrovidlng trainees with a variety of empirically 
validated, appropriately sequenced, learning experiences for the 
achievement of opera 1 1 ona 1 1 y defined performance object Ives . 

Answers to questions such as those posed by Krumholtz and 
Thoresen (1968) aie crucial to the development of such procedures: 

H l. What are the performance objectives In counselor 
education? 

2. What experiences. In what sequence(s), will best 
(In terms of efficiency of resources and effect- 
iveness) produce these per formnnees? 

3. What are the possible Interactive factors (trainee 
character! st les, entering skills, client behavior 
and ch a rac ter I s 1 1 cs, environmental variables, etc.) 
which require differential training procedures?" 



Answers to these questions, especially the first, must emerge from 
on empirically oriented model of the counseling task. Until 
recently efforts to conceptualize and define the counseling task 



O 

ERIC 



-i- 



2 



* 



have focused on hypothetical constructs relating to emblguous 
assumptions concerning the counselor's responsibility In 
establishing a social -emotional climate within the counseling 
setting* Not only were these process variables vague but they 
defied objective measurement. Myriad attempts to evaluate counselor 
and trainee manifestations of such constructs as accurate empathy, 
positive regard, congruence, warmth, etc. have been made (Halkides, 
1958; Bar re tt- Leona rd, 1959; Strupp, .I960; Truax, 1961; Carkhuff 
and Truax, 1965a, 1965b; Truax and Carkhuff, 1965; Martin, Berenson 
and Carkhuff/ 1966; Rerenson, Carkhuff and Myrus, 296G; Gross and 
DeRidder, 1966; Holder, Carkhuff and Berenson, 1967; Vander Veen, 
1967; Demos, 1967; Carkhuff and Alex » k, 1967; Berenson, Mitchers 
and Moravcc, 1968). All of these efforts, hov-ever, are cha racte r I zed 
by at least two fatal inherent weaknesses : (a) the assumption is 
made that specific process variables ore operating and then raters 
of similar persuasion are instructed in procedures for assessing 
them;^and C b ) although rater agreement is frequently high, serious 
questions must he raised concerning the contaminat Ing effects of 
rater bias (Hackney, 1969) and self-fulfilling expectations 
(Rosenthal and Jacobsen, I960). In 1967 Allen felt forced to con- 
clude that "counseling is becoming a process in search of a con- 
sequence, a cause earnestly seeking an effect," The need in 
counsel ing is not more research but higher quality research 
char actor I zed by (a) relevance, (b) disciplined inquiry, (c) new 
research models*, and (d) a systems orientation (Tfioresen, 1969 ). 

Po r forma nee . Object l,v,-?s 

A recent review of counseling research (Hosford ft Criskln, 

1969) suggests that the profession may he "entering a period of 
rew and creditable research v/itb a consequent closing of the gap 
between relationship and behavioral therapy p. 187 , M 

A growing body of evidence reveals that counselors, by means 
of their verbal repertoire within the counseling setting provide 
dl scriminatlve stimuli (Dulaney, 1961; Matarazzo, Saslowft Paries, 
1961; and Skinner, 19 57 ) and differential contingent re 1 nf orcemen t 
(Ball, 1953; Crowley, 1970; Krssner, 1958; lnce,'1968; Kennedy ft 
Zimner, 1968; Pepyne, 1968; Ryan A Kr.umboltz, 1966; Salzinger ft 
Plsoni, 1960; and V/askow, 1962) which elicit, shape and maintain 
cl i'ent verbal behavior. Verbal conditioning studies (Pepyne ft 
Zimmer, 1969) social learning research (Bandura ft Walters, 1963) 
and hypothesis generating factor analytic Investigations of 
counsel or-cl I ent verbal Interactions (Zimmer & Park, 1967; Zimmer 
ft Anderson, 1968; Zlnner, Wlghtman ft McArthur, 1970 ) provide new 
theoretical models and suggest innovative applications to both 
the counsel Ing process and the education of counselors who will 
engage In this process. Specifically verbal conditioning, social 
modeling and factor analytic paradigms separately and collectively 
provide promising vehicles for objective assessment of* the counseling 
task and for bridging the gap between conflicting counseling 
orientations, between counseling theory and learning theory and 
between counseling theory and practice. 
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A Fu net, i o n a? Anal ysis of the ; Counsel in g Task 



Operating from a behavioral perspective. Strong (1964) con- 
tended that: 

.t«the interview can be viewed as reciprocal verbal behavior 
usually between two people. The counselor talks then the 
uounselee talks, then again the counselor, and so on. 
Generally, other behaviors, such as nodding, smiling, and 
looking are liberally added to the on-going interlocking 
verbal behavior (p t 660), 

Within this frame of reference the effective counselor is con- 
ceptualized as one who (a) arranges stimulus conditions conducive 
to i densyncrat i c client verbalizations, (b) differentially rein- 
forces responses deemed appropriate within the counselor’s 
theoretical orientation and (c) extinguishes (does not reinforce) 
responses deemed I nnppropr i ate to the enabling and terminal 
behavioral goals of the specific counseling re 1 at i onsh I p . The 
consequent modification of the content, style and rnodd of the 
client's behavior in the counseling session (enabling objectives) 
Is assumed to generalize to other nodes of* behavior external to 
the counseling session (terminal objectives). The essence of 
this model of the counseling process if illustrated in simplified 
schematic form in Figure l, 

SCHEMATIC MODEL OF THE COUNSELING PROCESS 
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Figure 1 

Figure 1, Counselor provides subtle discriminative stimuli (S^) cueing 
the client as to the class of responses which will be reinforced. 

Client emits a variety of 1 deosyncrat i c response classes ( RY '* J 
. Counselor reinforces the response class (RJ|) deemed appro- 

priate within the context of his theoretical persuasion but does 
not reinforce client responses (R^; R^J ^rP which are contrary 

to the counselors conception of movement coward enabling objectives. 

The differentially reinforced client response doss (R)p increases 
In frequency and Is strengthened and shaped within the context of 
the counseling relationship. (enabling objectives). Over time the 
client generalizes the selected verbal response class to behavior 

external to the counseling Interview (terminal objectives.) 



Skinner (1957) presented a verbal behavior paradigm with high 
utility for a functional analysis of the counseling task* Skinner 
suggested that each verbal response by a participant In a conver- 
sational dyad serves a dual function: (a) each response possesses 

reinforcing properties for the response It follows and (b) discrimin- 
ative properties which Influence responses which follow It. This 
paradigm Illustrated In Figure 2 Implies that the counseling process 
Is a dynamic reciprocal interaction of counselor-client behavior. 

VERBAL BEHAVIOR PARADIGM OF 
COUNSELOR CLIENT INTERACTION 
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Figure 2. Each verbal response possesses both discrim- 
inative and reinforcing properties for the other participant. 



Counse lor : 
Cl lent: 



Through the use of modern research technology such as high 
speed computers, audio and video recording equipment etc. it has 
bocomepract i cable to take samples of counselor-client verbal 
Interactions and to s ystemat leal 1 y analyse so-called facilitating 
con "ructs and their inherent factor structures (Zimmer A Park, 

J9G#; Zimmer A Anderson, 1968; Zimmer, Nightman A McArthur, 1970), 
This pioneering research by Zimmer and his colleagues has produced 
data by which previously unmanageable hypothetical constructs can 
be reduced to operationally definable linguistic criteria. More- 
over, extensions of this factor analytic technique have produced 
evidence to dispell myths such as the contentions of Fiedler (1951) 
and Cartwright (1966) that what occurs tn counseling is affected 
by the expertise of the counselor and character I st i cs of the 
client, not by the counselor’s theoretical orientation or counseling 
style. Recently Zimmer and Popyne (1970) provided evidence that 
significant differences existed In the manifest behavior of three 
expert counselors while each was counseling the same client. Also, 
these observed differences were directly related to the respective 
theoretical orientations of the counselors. In a related study 
Hakstlan, Zimmer and Newby (1970) found that the same client 
responded and reacted differently on seven ou' of sever variables 
as a result of counseling with three export therapists. 

Counselor Ed ucat ion and Counseling. Research 

Through a continuing process of programmatic research (Zimmer, 
Pepyne, Hackney, A Crowley, 1969) It has become possible to 
Identify and analyze at least five counseling stylos. Within each 
style a variety of strategies have been Identified, To date 31 
discrete classes of counselor responses which Implement these 
stylos and strategies hove been Identified (Pepyne, Zimmer fi 
Hackney, 1969). Tills functionally oriented program ha s provided 
a means for objectively analyzing the counseling task and has laid 
the foundation and Implemented the development of a systems approach 
to counselor education known as the Counselor Repertoire Development 



(CRD) System. The programmatic development of the CRD System has 
been progressing for the past three years in accordance with the 
curriculum development model Illustrated In Figure 3. An Inspection 
of this model reveals the dynamic Interaction among research, 
training and evaluation components. Mot only does research con- 
tribute to curriculum development but follow-up against task 
application continually suggests priorities for counseling research 
in the areas of task, trainee and client population variables. 

Scope and Sequence of Training 

The CRD .System Is based on a conceptualization of the counselor’s 
task as (a) making fine grain discriminations of the client’s 
current response hierarchy and (b) differentiating his behavior 
to selectively cue, reinforce and ^hape client behavior In the 
direction of enabl Jng and terminal client-specific goals. 

Extrapolating from the analytical findings of Zimmer and his 
colleagues,* the present scope of the developing CRD System 
includes five discrete counseling styles. See Table 1, 

TABLE 1 

MODULES OF THE CRD SYSTEM 



Counsel 1 ng Style 


Prototype 


Passive - Receptive 


Carl Rogers 


Active - Confronting 


Frederick Peris 


Rat ional - Analyt Ic . ■ 


Albert Ellis 


fnterpretlve - Reconstructive 


Franz Alexander 


Active - Distributive 


Edmund W 1 1 1 1 amson 



Each style constitutes a module (unit of learning) In the CRD 
System. Each style Is subdivided Into therapeutic strategies. As 
an example. Table 2 lists the strategies Included within the 
Passive-Receptive Style of Counseling. Finally each strategy Is 
Implemented by operat ional ly defined classes of counselor verbal 
responses and related discriminations, 

instructional Model and Components 

The basic Instructional strategy of the CRD System places con- 
siderable responsibility on the trainee for the consequences of his 
learning activities, Figure 4 illustrates the Inter rel a t I onsh I ps 
among instructional components In the CRD System, 

In each module the trainee begins by obtaining a theoretical 
orientation to the target counseling style via selected texts 
and/or papers. Then, he Is presented with a video-taped model of 
experienced counselor employing the target style, Then, the 
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TABLE 2 



THERAPEUTIC STRATEGIES INCLUDED IM THE 
PASSIVE - RECEPTIVE STYLE OF COUNSELING 



Sequences 



S t rategy 



1 

2 

3 

U 

s 

6 

7 

8 



Initiating a Facilitating Relationship 
Establishing an Ambiguous Set 
Maintaining Client Verbal Responses 
Shaping Client Verbal Responses 
Commun I cat i ng Empath i c Understanding 
Establishing Connect i ons 
Terminating an Interview 
Terminating a Facilitative Relationship 



trainee assesses his acquisition of the theoretical orientation 
through the use of a remote computer terminal and Program Self- 
Assessment (Rcpyne, 1970). This program Is a t ra I nee-ccmpu ter 
Interactive testing pro gran which adnlnl sters, scores and files 
the results of te^ts on a largo number of topical areas. From a 
variety of Item pools (25 items each) the computer creates, by 
stratified random sampling, a great variety of confidence 
weighted, 5 Item tests of equivalent form, a concurrent validity 
of .79 to ,84 has been established between tests created by Program 
Self-Assessment and a criterion 50 Item test of similar material. 

If the trainee scores above a test-specific cut-off point he 
Is directed to proceed to a programmed workbook dealing with the 
Implementation of the counseling style, otherwise he Is directed 
to review the reference text(s). In a fully developed module, 
the programmed workbook Is supplemented by an audio or video- 
taped series of excerpts In which the trainee must discriminate 
the client response, produce an oral response and compare his 
response to a recorded model. After each set In the programmed 
workbook, the trainee Is directed to continue If ho has at; least 
90% response accuracy, otherwl se he is directed to review the set. 

Upon satisfactorily completing all sets In the programmed 
workbook, the trainee Is directed to assess his response clcss 
acquisition by again using Program Self-Assessment, This time the 
test administered requires the trainee to identify, within the 
context of the target counseling style, the counselor response 
most appropriate for a given client statement. Again, the results 
of the assessment are reported and filed and the trainee Is 
directed to continue or review specific sets in the programmed 
wo rkbook . 

In the trainee's sequential progress from theoretical 
orientation to accurate counseling task application, the next step 
Is to assess his ability to discriminate client statements and 
O create appropriate responses. This Is accomplished through a 
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simulated social Interaction computer program called Program 
Counseling Exercises (Pepyne, 1970)* Here/ the computer assumes 
the role of a disturbed client and responds di f ferent ial 1 y in terms 
of the trainee's accuracy In operating within the context of the 
given counseling style. Upon completion of the Interactive com- 
puter exercise/ a diagnostic assessment of the trainee's response 
class accuracy is presented* Successful Interaction wl th Program 
Counseling Exercise directs the trainee to participate In a video- 
taped 10 minute counseling exercise with a volunteer subject; 
otherwise/ he Is directed to review specific sets In the programmed 
workbook. 

After the video-tape of the counseling exercise has been pre- 
pared a computer program called/ Program Interview Analysis 
(Pepyne/ 1970) permits the supervisor, while observing the exercise 
with the trainee, to code each discrete client and trainee responses. 
At the conclusion of the exercise these paired codings are entered 
as data into the program and an interactive process analysis matrix 
with a diagnostic statistical summary is produced by the computer. 

At least two analytical variations are possible with this 
assessment procedure. By arranging a series of small buttons ori 
the arms of the trainee's chair (Madaus, In progress; Stanton, in 
progress) and a series of small lights cn the back of the client's 
chair, the trainee is enabled to signal the class number of the 
response he Is planning to emit. By comparing the response class 
signalled with the response class emitted, it is possible to 
determine whether the trainee Is emitting the response class he 
Intends. A comparison of the supervisor generated matrix with the 
trainee tag matrix permits a differential diagnosis of trainee 
errors. Tho supervisor generated matrix compares responses re- 
quired with responses emitted. The trainee tag matrix compares 
responses Intended with responses emitted. Low percent accuracy 
on the supervisor matrix and high percent accuracy on tho trainee 
tag matrix, for example, indicates errors in strategy rather than 
In response class construction. 

In addition to presenting the supervisor with a video-tape 
of the counseling exercise the trainee also presents an uncoded* 
typescript of interview interaction. -This typescrlot can be pre- 
pared in computer readable form on Novar magnetic tape cassettes, 
paper tapes or data cards. Program Interview Content Analysis 
(Pepyne, 1970) Is used on remote terminals or Program Conanaly 
(Zimmer A Cowles, in progress) is used for botch mode processing. 
These programs provide linguistic analyses of the verbal content 
of a counseling Interview. They have been designed as tools for 
evaluation and research relating to outcomes (enabling objectives) 
of counselor-client Interaction. The programs allow for analysis 
of an interview In whole or in seq r, cnt1al segments. The Increase 



Typescripts are encoded except that pronoun referents are In- 
cluded in parentheses . eg. 11 1 like my teacher but he (teacher) 
doesn't seem to like no." 
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or decrease in selected client-response classes can he sequentially 
analyzed. For example/ increased use of sel f-refercnce responses, 
containing the pronouns "I", "we 11 , "me", "us", "my M or "our" 
(Kennedy and Zimmer, 1968), positive affect responses, containing 
such key words as "love 11 , "like", "happy", "joy" etc, (Crowley, 
1970), deliberation or decision making responses (Ryan A 
Krumboltz, 1964) and other response classes have been suggested 
as viable enabling objectives of the counseling process. Program 
Interview Content Analysis and Program Conanaly provide tools to 
begin objective studies of what happens to client verbal behavior 
as a result of differences within and between varied counseling 
styles, Outputs from these programs also possess potential for 
use In a factor analytic approach to studying themes in interview 
content (Harway A Iker, 1966). 



t riplications of Proposed CRD Training Model 

The proposed model. In accordance with the schematic represen- 
tation In Figure ?, is based upon an empirical functional analysis 
of the counseling task. Task analyses, based upon the work of 
Z'mmer and others, have been translated Into observable, measur- 
able performance objectives ope ra t i onal 1 y stated as styles, 
strategies and related discriminations and response class con- 
stellations. Through a continuous progress program of Instruction, 
proceding from theoretical orientation to task application, and 
criteria referenced Sequential Automated Monitoring of Counselor 
Repertoire Development (SAMQCORD), the model provides a dynamic 
interaction among basic research, train ing and evaluative activities 
Questions, previously extremely resistant to empirical Investi- 
gation, now become amenable to rigorously controlled research. 

Among the most pressing questions are these: 

1. What functional relationship exists between a trainee’s 
level of achievement of various instructional objectives 
and the effect of his counseling task performance on the 
movement of various clients toward specific enabling 
objectives. In other words, what is the relative 
validity of current notions, concerning counselor edu- 
cation content and evaluation criteria for trainees, 

In terms of the effects of the trainees counseling 
‘ task performance on the behavior of various clients? 

2. What main effects or Interactions exist among trainee 
character i sties and various i ns t ruct ' ona 1 modes and 
sequences on the acquisition of various performance 
objectives? Answers to this question hold Important 
Implications for tailoring I nst ruct f ona 1 prescriptions 
to trainee cha racte r I c t t cs and for liberalizing or 
limiting admission requirements of counselor education 
programs. 

3. What relationships exist among the accuracy of the 
trainee’s counseling task per f ormanre * and his effect 
on client Interview behavior In terns of specific 
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enabling objectives? This question holds the potential 
of resolving controversies concerning the relative 
importance of process vs outcome evaluative criteria. 

4. What are the effects and interactions of trainee chara- 
cteristics, level of performance achievement, time 
since program completion and clinical setting on the 
counseling effectiveness of trainees after course com- 
pletion. In other words, might Tt he Possible to develop 
an empirically based formula for predicting trainee 
success In various clinical settings and, hence, more 
approprl atcl y match the trainee with sources of practlcum, 
internship and job placement. 

5. What main effects and *nteractions exist among counselor 
response classes, non-verbal behavior and proxernlc 
variables on selected classes of client responses? 

Answers to this question will undoubtedly suggest modi- 
fications In present educational objectives and 
Instructional strategies. At this point In time only the 
semantic and syntactic character ! st les of counselor verbal 
responses have been subjected to serious study. Even here, 
however, intonaf ional , amplitude and cadence character i st I cs 
of counselor verbal responses deserve Increased attention. 

6. How do client character i si i cs and/or categories of enabling 
objectives influence the effectiveness of various 
counselor response classes, therapeutic strategies and 
counseling styles? Precise answers to this question have 
dramatic implications fer the emergence of a dynamic 
eclecticism based on client needs rather than monolithic 
theoretical persuas ion. 

7 . Can client responses be analyzed, classified and organized 
In order to facilitate trainee discrimination of current 
client response hierarchies and prediction of the 
relative ease of attaining specific enabling objectives 
with given clients. A viable answer to this question 
could shift the function of clinical judgement from a 
capricious art to statistically predictable process. 

Other questions could he added to this list. However, those 
posed appear to be the logical next steps In a programrnat i c 
attempt to bring counseling and the training of those who will 
practice it under the aegis of an empirically based technology. 
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